Published in Insights and Data·PinnedInsights and DataIs your love affair with Data missing some "Spark"? Data Connects and Speaks (Does it for you? reach out, will make it happen) — I've always been fascinated by data, and I love the ability to gather information and turn it into valuable insights. We live in an age where data are abundant at our fingertips. …Insights And Data3 min read
Published in Insights and Data·11 hours agoExport a Notebook from DatabricksIn this short article, we learn to export and import a notebook from the Databricks workspace step by step. Export / Import is an essential feature when we work with teams. Let’s start with the export feature: Once you create your databricks service and login into the service. navigate to the workspace → Users → Your…Databricks2 min read
Published in Insights and Data·11 hours agoDisplay vs Show Spark DataframeSo far we used “show” to look at the data in the dataframe, let's find some exciting ways to look at your data. We just created our first dataframe using the output of the Range function, and we also looked at the content of the dataframe using the dataframe.show() #Dataframe_Name.show()…Databricks3 min read
Published in Insights and Data·11 hours agoCreate your first Spark DataframeOnce we understand what a dataframe is, In this article, we learn how to create your first dataframe. In Python, we have a range function to generate a range of values from start to end numbers with given steps. #range(start_number, end_number, step) range(5) #give you -> 0, 1, 2, 3…Databricks2 min read
Published in Insights and Data·2 days agoDatabricks Notebook Magic CommandsMagic commands in Databricks let you execute the code snippets other than the default language of the notebook. Magic command start with %<Choice of Your code snippet language> Databricks supports four languages Python, SQL, Scala, and R Following are possible magic commands available in Databricks %python %sql %scala %sh %fs → Alternatively, one can use dbutils.fs %md For…Databricks2 min read
4 days agoCelebrating 1000 Followers on MediumI am humbled and thankful for the 1000 people who have followed me on Medium. I repeat myself that I am so happy to see that this blog has a thousand followers now since I started in Jan 2022. I appreciate you for coming back here every day and reading…Medium2 min read
Published in Insights and Data·5 days agoPractice Math Skills with Python Snippet for KidsThe idea of this article is to provide kids with a simple Python code snippet to help them get started with mathematics and have them engaged with it. Practicing math skills is important for kids as it helps them develop mental arithmetic. The challenge for adults and parents is to…Python5 min read
Published in Insights and Data·5 days agoAre you moving to Cloud?Digital transformation is a strategy that helps you transform to become more agile and innovative in your Business. It means moving to the Cloud and removing the traditional on-premise hassles. Cloud infrastructure helps you focus on your work by utilizing the best tools and technology for your business needs. When…Data Engineering3 min read
Published in Insights and Data·5 days ago6 Principles of Successful Data Strategy for BusinessAs per MIT technology review 2020, only 13% of Organizations could handle their Enterprise data effectively to get the right business insights for strategic growth. Why Data Strategy: This article discusses six principles of successful data strategy in business. Data strategy is not just a top-level strategy but needs to incorporate into all…Insights And Data4 min read
Published in Insights and Data·5 days agoAccelerate Job Executions in DatabricksThe story starts with a data scientist/data engineer/data analyst working on how difficult it has been to complete one job with large volumes of data. For example, one of the jobs it’s taken 8 hours to complete, and that’s because he has been executing it sequentially. He is curious if…Databricks3 min read