- Видео 154
- Просмотров 6 662 059
Darshil Parmar
Индия
Добавлен 13 апр 2021
Freelance Data Engineer and Solution Architect.
I love learning about technology and teaching thing I know to other people. The goal of creating this channel was to teach everything I know to the world, I have spent most of my time learning things online and I want to share all my learning on this youtube channel.
I will be posting content related to data engineering, architecting systems, data science, machine learning, and interview preparation.
Happy Learning :)
I love learning about technology and teaching thing I know to other people. The goal of creating this channel was to teach everything I know to the world, I have spent most of my time learning things online and I want to share all my learning on this youtube channel.
I will be posting content related to data engineering, architecting systems, data science, machine learning, and interview preparation.
Happy Learning :)
Data Engineering Was Hard Until I Learned These 5 Secrets!
Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479
USE CODE: COMBO50 for 50% off
Learn more about courses here - datavidhya.com/courses
In this video, we will talk about the top 5 game-changing secrets that made data engineering much easier for me. Discover how mastering essential tools, optimizing workflows, and boosting productivity can transform your data engineering journey.
👦🏻 My Linkedin - www.linkedin.com/in/darshil-parmar/
📷 Instagram - datawithdarshil
🎯Twitter - parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life ...
USE CODE: COMBO50 for 50% off
Learn more about courses here - datavidhya.com/courses
In this video, we will talk about the top 5 game-changing secrets that made data engineering much easier for me. Discover how mastering essential tools, optimizing workflows, and boosting productivity can transform your data engineering journey.
👦🏻 My Linkedin - www.linkedin.com/in/darshil-parmar/
📷 Instagram - datawithdarshil
🎯Twitter - parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life ...
Просмотров: 30 586
Видео
Learn Kafka in 10 Minutes | Most Important Skill for Data Engineering
Просмотров 18 тыс.14 дней назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses Code used in video - github.com/darshilparmar/kafka-in-10min-video-code Apache Kafka is one of the most important skills to learn as a Data Engineer, Top companies use Kafka to process real...
My Data Engineering Journey in 5 Minutes | Projects | Tools
Просмотров 13 тыс.Месяц назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses In this video, I have shared my experience of working as a Data Engineering for the last 5 years, from the projects to the tech stack that I worked on. 👦🏻 My Linkedin - www.linkedin.com/in/...
What Does a Data Engineer Do? Explained Simply
Просмотров 16 тыс.2 месяца назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will understand wh...
The State of Data Engineering in 2024 - Jobs, Salary, Layoff, AI and Future
Просмотров 44 тыс.2 месяца назад
Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Learn more about courses here - datavidhya.com/courses The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will talk about sa...
IPL Data Analysis | Apache Spark End-To-End Data Engineering Project
Просмотров 58 тыс.2 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off In this video, we are going to analyze IPL data by building a data pipeline, main focus of this video is to focus on writing Apache Spark...
You're not stupid: How to learn difficult things | Complete Guide
Просмотров 21 тыс.3 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off How To Take Technical Notes? One of the best ways to retain whatever you learn is by preserving the information that you can access as pe...
Best Apache Spark Course with Databricks for Data Engineering | 2 End-To-End Projects
Просмотров 20 тыс.3 месяца назад
Enroll in the Apache Spark Course Here - datavidhya.com/courses/apache USE CODE: EARLYSPARK for 50% off ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Best course on Apache Spark with Databricks, you will learn everything from basics fundamentals, internal working, hands-on practice, an ...
How I Got 60LPA Remote Job as Data Engineer
Просмотров 133 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT...
How To Read Tech Books? (Things I learned after reading 21 books)
Просмотров 12 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT...
Data Engineering Certifications To Get Ahead Of 99% People
Просмотров 44 тыс.4 месяца назад
Join My Data Engineering Course Here: datavidhya.com/courses You can directly purchase here: ➡️ Python SQL Data Warehouse Combo Plan - courses.datavidhya.com/checkout/zwbzl8e2Cx?code=COMBO50 Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT50 3. Data Warehouse for D...
Learn Snowflake in 10 Minutes| High Paying Skills | Step by Step Hands-On Guide
Просмотров 197 тыс.5 месяцев назад
Join My Snowflake Data Engineering Course Here: datavidhya.com/courses/datawarehouse ➡️ Combo Package Python SQL Data warehouse (Snowflake) Apache Spark: com.rpy.club/pdp/yYnEMzLOX?plan=6607b619c69cf00b7b934479 USE CODE: COMBO50 for 50% off Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/...
AWS Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Просмотров 42 тыс.5 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses In this video, we will talk about how to become an AWS Data Engineer, the complete roadmap, top services to learn, and how to prepare for a certificate, I hope you find it useful. Resources mentioned in video: datawithdarshil.notion.site/AWS-Data-Engineering-Roadmap-cc3689031faf4e11b591df1a9139326f?pvs=4 🌟 Please leave a LIKE ❤️ and S...
Best Way To Land Data Analytics/Engineering/Science Job in 2024
Просмотров 21 тыс.6 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses USE CODE: MERRYCHRISTMAS to get 50% off on courses Find Resources Mentioned In Video: datawithdarshil.notion.site/Cracking-DE-Interview-Guide-30725b58ae2b43f391c31d0b64b003fa?pvs=4 Timestamps 0:00 Why Data Engineering is the best career & Job openings 1:29 Getting Your Basics Clear 2:23 How To Build Data Portfolio Projects 5:51 How To...
God Tier Data Engineering Roadmap 2024 with End-To-End Projects
Просмотров 140 тыс.6 месяцев назад
Join My Data Engineering Course Here: datavidhya.com/courses You can directly purchase here: ➡️ Python SQL Data Warehouse Combo Plan - courses.datavidhya.com/checkout/zwbzl8e2Cx?code=COMBO50 Purchase Individual Courses: 1. Python for Data Engineering - pay.datavidhya.com/cop/UHfHDhbKVS?code=PYT50 2. SQL for Data Engineering - pay.datavidhya.com/cop/x4UpBcaKsi?code=SQLT50 3. Data Warehouse for D...
My High Paying Data Engineering Projects Explained
Просмотров 20 тыс.7 месяцев назад
My High Paying Data Engineering Projects Explained
Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Просмотров 107 тыс.7 месяцев назад
Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
Recession Proof Data Roles To Focus in 2024 | Simply Explained
Просмотров 21 тыс.7 месяцев назад
Recession Proof Data Roles To Focus in 2024 | Simply Explained
These Data Engineering Projects Give You An Unfair Advantage
Просмотров 61 тыс.8 месяцев назад
These Data Engineering Projects Give You An Unfair Advantage
Asking Senior Engineer Manager about AI killing Coding Jobs? | Vlog 1
Просмотров 37 тыс.8 месяцев назад
Asking Senior Engineer Manager about AI killing Coding Jobs? | Vlog 1
High Paying Technologies You Should Learn In 2024
Просмотров 46 тыс.9 месяцев назад
High Paying Technologies You Should Learn In 2024
Learn Apache Airflow in 10 Minutes | High-Paying Skills for Data Engineers
Просмотров 143 тыс.9 месяцев назад
Learn Apache Airflow in 10 Minutes | High-Paying Skills for Data Engineers
Complete Freelance Guide | How I Earned $50000 in 6 Months as Freelance Data Engineer
Просмотров 146 тыс.9 месяцев назад
Complete Freelance Guide | How I Earned $50000 in 6 Months as Freelance Data Engineer
High-Paying Skill for Data Engineers | Master Data Warehouse with 4 Projects
Просмотров 18 тыс.10 месяцев назад
High-Paying Skill for Data Engineers | Master Data Warehouse with 4 Projects
Olympic Data Analytics | Azure End-To-End Data Engineering Project
Просмотров 299 тыс.11 месяцев назад
Olympic Data Analytics | Azure End-To-End Data Engineering Project
Freelance Data Engineer Shares His High Paying Projects
Просмотров 30 тыс.11 месяцев назад
Freelance Data Engineer Shares His High Paying Projects
Learn Apache Spark in 10 Minutes | Step by Step Guide
Просмотров 273 тыс.Год назад
Learn Apache Spark in 10 Minutes | Step by Step Guide
Best Data Engineering Books for Beginners
Просмотров 15 тыс.Год назад
Best Data Engineering Books for Beginners
How Dream 11 Process 7TB of Data Daily?
Просмотров 9 тыс.Год назад
How Dream 11 Process 7TB of Data Daily?
Azure Data Engineering Certification Step by Step Guide
Просмотров 131 тыс.Год назад
Azure Data Engineering Certification Step by Step Guide
Hey Darshil, the above SQL course link is not working can you please check it says page not found
I completed my b. Com computers and later i have competed my masters in marketing domain. Is am a eligible for a data engineer
This E2E project touches so many concepts and technologies, thanks so much for putting all these together. Really appreciate your effort. I loved executing this project.
Darshil now that you have more than 1.5k likes Could you please upload the data engineering fundamentals masterclass
I need to build a PPT, record, and edit video, it takes time! will upload once it is done
The mage-ai keeps showing me an error saying that kernel has restarted, I tried adding a disk and creating a virtual environment and also deploying it but no luck, can you guide me on how to tackle this issue, thanks!
Great video, thank you!
Love your reason you start thís RUclips channel : "Simplify everything" <3
Video content is so helpful. Than You Which AI platform or video editor are you using to create this video? Also for background music which platform are you using?
I have editor, they use Premier pro, bg music can be found from youtube music lib or google
Make video for aptitude
@DarshilParmar ... Is data Engineering is a suitable for someone who is love coding very much and don't like work with visualization stuff like dashboard, who like to focus on distributed systems, scalablility performanece and need to heavy logic thinking to do
Kya thi cho bhaiband?
i am not able to download java using "sudo yum install" on my windows laptop. how to do it?
really nice completed the project!! and more than what am so late for this video, if i was learning this earlier, i might have got more ideas, anyways thanks for your project dharshil :)
Great to hear!
To the point, quick, simple and comprehensive knowledge sharing!
I appreciate that!
Gr8 tutorial, I have been completed the project by using vm and postgresql. Could you please do a Kubernetes video like this. Thanks
i tried deploy button at 39:00 and changed time to 15 min (which is max), but it still shows timeout, anybody knows how to fix it?
Nice video!
Can a person from outside india . Can take data vidya combo course
Yes you can - datavidhya.com/combo-course-info
@@DarshilParmar and the subscription is for life time
@@hemanthvarupula9873 Yes
Which tool are you using to create architecture diagrams?
Google Slides
I will clear this exam in 20 days
Let's go
I had created an account on 24 June, From today total 8 days are remaining I.e till 25 july for my free trial period. But it gets deactivated and asking my credit card details, WILL THEY CHARGE ME ??
I had created an account on 24 June, From today total 8 days are remaining I.e till 25 july for my free trial period. But it gets deactivated and asking my credit card details, WILL THEY CHARGE ME ??
Use new email and create one
I will code consistently
Great job! with these projects Darshil, just a quick question, how would you go about adding this to your resume after you have completed the project?
you need to host it on github and then show it
@@DarshilParmar great, thank you very much.
Im going to become Data Engineer in next 8 months .. 🎯
Thanks for giving the valuable knowledge you haven't just reviewed this book but also spread the knowledge about it which makes people get more interest in data engineering , thank you dude you are doing great job 😊
Glad it was helpful!
Why do I not have the option of adding a directory option in containers to create folders as you did?
Found the solution as well, its because of not selecting hierarchical option during storage creation 😅
Thank you for great contributions to the community and make me realise to contribute something to the community. So I started recently contributing to the community with SQL interview preparation, problem and solution series. Soon I will contribute many Thank you.
Hey mate , great video. Thank you. Would you let me know what software do you use for video editing
I used to use FinalCutPro but now I have an editor who edits my videos
Brother, This is Maruthi… good work. I subscribed and referred my friend also. Looking forward to Master class on Fundamentals.
Sure
@DarshilParmar: Could you please help me here i am getting below error KafkaTimeoutError: KafkaTimeoutError: Batch for TopicPartition(topic='topic1', partition=0) containing 1 record(s) expired: 30 seconds have passed since batch creation plus linger time
Security Group issues
@@DarshilParmar could you please let me know which SG rule is required here as I have selected the ssh for all the ipv4 instead of my ip
@@shubhammishra2511 open all first then turn of one by one
@@DarshilParmar thanks lot Darshil for your reply, let me try again to check these SGs port.
I watched this video till the end
I am going to become a data engineer
Hi Darshil,Thanks for the amazing video...im facing issue while creating kafka topic, could see connection time out...can you please suggest the solution
Security Group issues
Helpful
"errorMessage": "An error occurred (EntityNotFoundException) when calling the CreateTable operation: Database db_youtube_cleaned not found.", I have created all the ENV variable and also add role Glue for allow access, but still getting this error. this DB should create automatically, Right?
Create it manually on Athena
ruclips.net/video/JDRfdFBxDJ8/видео.htmlsi=yV8RUIiUdv0lTZhZ This course is not available now, can you please adivse
for SQL - datavidhya.com/all-course/:SQL%20for%20Data%20Engineering for combo - datavidhya.com/combo-course-info
Course link is not working, 404 Error
watched till the end good video thanks for the guidance❤
Can you please come up with Kafka end to end series for your people...
will be launching course on this soon
Getting a job by 2025.
Darshil should I python oops for data engineer
Yes
❤
Thank you bro , really helpful ❤
Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?
Plz ,anyone can tell me which CSE specialization should i choose for data engineering ??
Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?