Darshil Parmar
Darshil Parmar
  • Видео 154
  • Просмотров 6 662 059
Data Engineering Was Hard Until I Learned These 5 Secrets!
Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479
USE CODE: COMBO50 for 50% off
Learn more about courses here - datavidhya.com/courses
In this video, we will talk about the top 5 game-changing secrets that made data engineering much easier for me. Discover how mastering essential tools, optimizing workflows, and boosting productivity can transform your data engineering journey.
👦🏻 My Linkedin - www.linkedin.com/in/darshil-parmar/
📷 Instagram - datawithdarshil
🎯Twitter - parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life ...
Просмотров: 30 586

Видео

Learn Kafka in 10 Minutes | Most Important Skill for Data Engineering
Просмотров 18 тыс.14 дней назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses Code used in video - github.com/darshilparmar/kafka-in-10min-video-code Apache Kafka is one of the most important skills to learn as a Data Engineer, Top companies use Kafka to process real...
My Data Engineering Journey in 5 Minutes | Projects | Tools
Просмотров 13 тыс.Месяц назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses In this video, I have shared my experience of working as a Data Engineering for the last 5 years, from the projects to the tech stack that I worked on. 👦🏻 My Linkedin - www.linkedin.com/in/...
What Does a Data Engineer Do? Explained Simply
Просмотров 16 тыс.2 месяца назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will understand wh...
The State of Data Engineering in 2024 - Jobs, Salary, Layoff, AI and Future
Просмотров 44 тыс.2 месяца назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will talk about sa...
IPL Data Analysis | Apache Spark End-To-End Data Engineering Project
Просмотров 58 тыс.2 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off In this video, we are going to analyze IPL data by building a data pipeline, main focus of this video is to focus on writing Apache Spark...
You're not stupid: How to learn difficult things | Complete Guide
Просмотров 21 тыс.3 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off How To Take Technical Notes? One of the best ways to retain whatever you learn is by preserving the information that you can access as pe...
Best Apache Spark Course with Databricks for Data Engineering | 2 End-To-End Projects
Просмотров 20 тыс.3 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Best course on Apache Spark with Databricks, you will learn everything from basics fundamentals, internal working, hands-on practice, an ...
How I Got 60LPA Remote Job as Data Engineer
Просмотров 133 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT...
How To Read Tech Books? (Things I learned after reading 21 books)
Просмотров 12 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT...
Data Engineering Certifications To Get Ahead Of 99% People
Просмотров 44 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses You can directly purchase here: ➡️ Python SQL Data Warehouse Combo Plan - courses.datavidhya.com/checkout/zwbzl8e2Cx?code=COMBO50 Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT50 3. Data Warehouse for D...
Learn Snowflake in 10 Minutes| High Paying Skills | Step by Step Hands-On Guide
Просмотров 197 тыс.5 месяцев назад
Join My Snowflake Data Engineering Course Here: datavidhya.com/courses/datawarehouse ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/...
AWS Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Просмотров 42 тыс.5 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses In this video, we will talk about how to become an AWS Data Engineer, the complete roadmap, top services to learn, and how to prepare for a certificate, I hope you find it useful. Resources mentioned in video: datawithdarshil.notion.site/AWS-Data-Engineering-Roadmap-cc3689031faf4e11b591df1a9139326f?pvs=4 🌟 Please leave a LIKE ❤️ and S...
Best Way To Land Data Analytics/Engineering/Science Job in 2024
Просмотров 21 тыс.6 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses USE CODE: MERRYCHRISTMAS to get 50% off on courses Find Resources Mentioned In Video: datawithdarshil.notion.site/Cracking-DE-Interview-Guide-30725b58ae2b43f391c31d0b64b003fa?pvs=4 Timestamps 0:00 Why Data Engineering is the best career & Job openings 1:29 Getting Your Basics Clear 2:23 How To Build Data Portfolio Projects 5:51 How To...
God Tier Data Engineering Roadmap 2024 with End-To-End Projects
Просмотров 140 тыс.6 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses You can directly purchase here: ➡️ Python SQL Data Warehouse Combo Plan - courses.datavidhya.com/checkout/zwbzl8e2Cx?code=COMBO50 Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT50 3. Data Warehouse for D...
My High Paying Data Engineering Projects Explained
Просмотров 20 тыс.7 месяцев назад
My High Paying Data Engineering Projects Explained
Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Просмотров 107 тыс.7 месяцев назад
Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Recession Proof Data Roles To Focus in 2024 | Simply Explained
Просмотров 21 тыс.7 месяцев назад
Recession Proof Data Roles To Focus in 2024 | Simply Explained
These Data Engineering Projects Give You An Unfair Advantage
Просмотров 61 тыс.8 месяцев назад
These Data Engineering Projects Give You An Unfair Advantage
Asking Senior Engineer Manager about AI killing Coding Jobs? | Vlog 1
Просмотров 37 тыс.8 месяцев назад
Asking Senior Engineer Manager about AI killing Coding Jobs? | Vlog 1
High Paying Technologies You Should Learn In 2024
Просмотров 46 тыс.9 месяцев назад
High Paying Technologies You Should Learn In 2024
Learn Apache Airflow in 10 Minutes | High-Paying Skills for Data Engineers
Просмотров 143 тыс.9 месяцев назад
Learn Apache Airflow in 10 Minutes | High-Paying Skills for Data Engineers
Complete Freelance Guide | How I Earned $50000 in 6 Months as Freelance Data Engineer
Просмотров 146 тыс.9 месяцев назад
Complete Freelance Guide | How I Earned $50000 in 6 Months as Freelance Data Engineer
High-Paying Skill for Data Engineers | Master Data Warehouse with 4 Projects
Просмотров 18 тыс.10 месяцев назад
High-Paying Skill for Data Engineers | Master Data Warehouse with 4 Projects
Olympic Data Analytics | Azure End-To-End Data Engineering Project
Просмотров 299 тыс.11 месяцев назад
Olympic Data Analytics | Azure End-To-End Data Engineering Project
Freelance Data Engineer Shares His High Paying Projects
Просмотров 30 тыс.11 месяцев назад
Freelance Data Engineer Shares His High Paying Projects
Learn Apache Spark in 10 Minutes | Step by Step Guide
Просмотров 273 тыс.Год назад
Learn Apache Spark in 10 Minutes | Step by Step Guide
Best Data Engineering Books for Beginners
Просмотров 15 тыс.Год назад
Best Data Engineering Books for Beginners
How Dream 11 Process 7TB of Data Daily?
Просмотров 9 тыс.Год назад
How Dream 11 Process 7TB of Data Daily?
Azure Data Engineering Certification Step by Step Guide
Просмотров 131 тыс.Год назад
Azure Data Engineering Certification Step by Step Guide

Комментарии

  • @Akbar_Speaks
    @Akbar_Speaks День назад

    Hey Darshil, the above SQL course link is not working can you please check it says page not found

  • @SurprisedGlobe-yq5uh
    @SurprisedGlobe-yq5uh 2 дня назад

    I completed my b. Com computers and later i have competed my masters in marketing domain. Is am a eligible for a data engineer

  • @ShylajaNagineni
    @ShylajaNagineni 2 дня назад

    This E2E project touches so many concepts and technologies, thanks so much for putting all these together. Really appreciate your effort. I loved executing this project.

  • @kakahalwaipunawale7991
    @kakahalwaipunawale7991 2 дня назад

    Darshil now that you have more than 1.5k likes Could you please upload the data engineering fundamentals masterclass

    • @DarshilParmar
      @DarshilParmar 2 дня назад

      I need to build a PPT, record, and edit video, it takes time! will upload once it is done

  • @khadijahk5137
    @khadijahk5137 2 дня назад

    The mage-ai keeps showing me an error saying that kernel has restarted, I tried adding a disk and creating a virtual environment and also deploying it but no luck, can you guide me on how to tackle this issue, thanks!

  • @chirapamuadchan6791
    @chirapamuadchan6791 2 дня назад

    Great video, thank you!

  • @ZzzZ-vi5xb
    @ZzzZ-vi5xb 2 дня назад

    Love your reason you start thís RUclips channel : "Simplify everything" <3

  • @viplavdube7953
    @viplavdube7953 2 дня назад

    Video content is so helpful. Than You Which AI platform or video editor are you using to create this video? Also for background music which platform are you using?

    • @DarshilParmar
      @DarshilParmar 2 дня назад

      I have editor, they use Premier pro, bg music can be found from youtube music lib or google

  • @meetpatel2720
    @meetpatel2720 3 дня назад

    Make video for aptitude

  • @AtiaNasr
    @AtiaNasr 3 дня назад

    @DarshilParmar ... Is data Engineering is a suitable for someone who is love coding very much and don't like work with visualization stuff like dashboard, who like to focus on distributed systems, scalablility performanece and need to heavy logic thinking to do

  • @gadget_comparision_360
    @gadget_comparision_360 3 дня назад

    Kya thi cho bhaiband?

  • @ShubhamRajendraGandam
    @ShubhamRajendraGandam 3 дня назад

    i am not able to download java using "sudo yum install" on my windows laptop. how to do it?

  • @I_am_depp_
    @I_am_depp_ 3 дня назад

    really nice completed the project!! and more than what am so late for this video, if i was learning this earlier, i might have got more ideas, anyways thanks for your project dharshil :)

  • @darshakmehta
    @darshakmehta 4 дня назад

    To the point, quick, simple and comprehensive knowledge sharing!

  • @venkatrangu9572
    @venkatrangu9572 4 дня назад

    Gr8 tutorial, I have been completed the project by using vm and postgresql. Could you please do a Kubernetes video like this. Thanks

  • @lihongzheng8216
    @lihongzheng8216 4 дня назад

    i tried deploy button at 39:00 and changed time to 15 min (which is max), but it still shows timeout, anybody knows how to fix it?

  • @amadoucisse2692
    @amadoucisse2692 4 дня назад

    Nice video!

  • @hemanthvarupula9873
    @hemanthvarupula9873 4 дня назад

    Can a person from outside india . Can take data vidya combo course

  • @izhanabdullah
    @izhanabdullah 5 дней назад

    Which tool are you using to create architecture diagrams?

  • @sun2020able
    @sun2020able 5 дней назад

    I will clear this exam in 20 days

  • @_DEBANJANDHAR
    @_DEBANJANDHAR 5 дней назад

    I had created an account on 24 June, From today total 8 days are remaining I.e till 25 july for my free trial period. But it gets deactivated and asking my credit card details, WILL THEY CHARGE ME ??

  • @_DEBANJANDHAR
    @_DEBANJANDHAR 5 дней назад

    I had created an account on 24 June, From today total 8 days are remaining I.e till 25 july for my free trial period. But it gets deactivated and asking my credit card details, WILL THEY CHARGE ME ??

  • @mohanprasath1781
    @mohanprasath1781 5 дней назад

    I will code consistently

  • @sLaVeOfALLaH20
    @sLaVeOfALLaH20 5 дней назад

    Great job! with these projects Darshil, just a quick question, how would you go about adding this to your resume after you have completed the project?

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      you need to host it on github and then show it

    • @sLaVeOfALLaH20
      @sLaVeOfALLaH20 4 дня назад

      @@DarshilParmar great, thank you very much.

  • @praxis_man_of_action6382
    @praxis_man_of_action6382 5 дней назад

    Im going to become Data Engineer in next 8 months .. 🎯

  • @piyushlingayat3744
    @piyushlingayat3744 5 дней назад

    Thanks for giving the valuable knowledge you haven't just reviewed this book but also spread the knowledge about it which makes people get more interest in data engineering , thank you dude you are doing great job 😊

  • @sharans5771
    @sharans5771 6 дней назад

    Why do I not have the option of adding a directory option in containers to create folders as you did?

    • @sharans5771
      @sharans5771 6 дней назад

      Found the solution as well, its because of not selecting hierarchical option during storage creation 😅

  • @MeanLifeStudies
    @MeanLifeStudies 6 дней назад

    Thank you for great contributions to the community and make me realise to contribute something to the community. So I started recently contributing to the community with SQL interview preparation, problem and solution series. Soon I will contribute many Thank you.

  • @ezeefied
    @ezeefied 6 дней назад

    Hey mate , great video. Thank you. Would you let me know what software do you use for video editing

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      I used to use FinalCutPro but now I have an editor who edits my videos

  • @maruthiraoyarapathineni2012
    @maruthiraoyarapathineni2012 6 дней назад

    Brother, This is Maruthi… good work. I subscribed and referred my friend also. Looking forward to Master class on Fundamentals.

  • @shubhammishra2511
    @shubhammishra2511 6 дней назад

    @DarshilParmar: Could you please help me here i am getting below error KafkaTimeoutError: KafkaTimeoutError: Batch for TopicPartition(topic='topic1', partition=0) containing 1 record(s) expired: 30 seconds have passed since batch creation plus linger time

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      Security Group issues

    • @shubhammishra2511
      @shubhammishra2511 4 дня назад

      @@DarshilParmar could you please let me know which SG rule is required here as I have selected the ssh for all the ipv4 instead of my ip

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      @@shubhammishra2511 open all first then turn of one by one

    • @shubhammishra2511
      @shubhammishra2511 4 дня назад

      @@DarshilParmar thanks lot Darshil for your reply, let me try again to check these SGs port.

  • @sujeethar7957
    @sujeethar7957 6 дней назад

    I watched this video till the end

  • @sujeethar7957
    @sujeethar7957 6 дней назад

    I am going to become a data engineer

  • @reshmabhanu7336
    @reshmabhanu7336 6 дней назад

    Hi Darshil,Thanks for the amazing video...im facing issue while creating kafka topic, could see connection time out...can you please suggest the solution

  • @gauravg2359
    @gauravg2359 6 дней назад

    Helpful

  • @milindshingote156
    @milindshingote156 7 дней назад

    "errorMessage": "An error occurred (EntityNotFoundException) when calling the CreateTable operation: Database db_youtube_cleaned not found.", I have created all the ENV variable and also add role Glue for allow access, but still getting this error. this DB should create automatically, Right?

  • @nitinshokeen6090
    @nitinshokeen6090 7 дней назад

    ruclips.net/video/JDRfdFBxDJ8/видео.htmlsi=yV8RUIiUdv0lTZhZ This course is not available now, can you please adivse

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      for SQL - datavidhya.com/all-course/:SQL%20for%20Data%20Engineering for combo - datavidhya.com/combo-course-info

  • @nitinshokeen6090
    @nitinshokeen6090 7 дней назад

    Course link is not working, 404 Error

  • @mohamedarbibouhejba5499
    @mohamedarbibouhejba5499 7 дней назад

    watched till the end good video thanks for the guidance❤

  • @user-yd3zk4hb1o
    @user-yd3zk4hb1o 7 дней назад

    Can you please come up with Kafka end to end series for your people...

    • @DarshilParmar
      @DarshilParmar 4 дня назад

      will be launching course on this soon

  • @sunnyraj3636
    @sunnyraj3636 7 дней назад

    Getting a job by 2025.

  • @penumalasreekanth
    @penumalasreekanth 7 дней назад

    Darshil should I python oops for data engineer

  • @karthiksundaram544
    @karthiksundaram544 7 дней назад

  • @asimmomin4604
    @asimmomin4604 7 дней назад

    Thank you bro , really helpful ❤

  • @lectures3727
    @lectures3727 8 дней назад

    Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?

  • @sandhya_608
    @sandhya_608 8 дней назад

    Plz ,anyone can tell me which CSE specialization should i choose for data engineering ??

  • @lectures3727
    @lectures3727 8 дней назад

    Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?