-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html
383 lines (369 loc) · 21 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
<!DOCTYPE html>
<html lang="en-US">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Shubham Jain</title>
<meta name="description" content="Bigdata Engineer | Spark | AWS | Hadoop | Azure."/>
<link href="https://fonts.googleapis.com/css?family=Montserrat:400,700,200" rel="stylesheet">
<link href="https://maxcdn.bootstrapcdn.com/font-awesome/latest/css/font-awesome.min.css" rel="stylesheet">
<link href="css/aos.css" rel="stylesheet">
<link href="css/bootstrap.min.css" rel="stylesheet">
<link href="styles/main.css" rel="stylesheet">
</head>
<body id="top">
<header>
<div class="profile-page sidebar-collapse">
<nav class="navbar navbar-expand-lg fixed-top navbar-transparent bg-primary" color-on-scroll="400">
<div class="container">
<div class="navbar-translate"><a class="navbar-brand" href="#" rel="tooltip">Shubham Jain</a>
<button class="navbar-toggler navbar-toggler" type="button" data-toggle="collapse" data-target="#navigation" aria-controls="navigation" aria-expanded="false" aria-label="Toggle navigation"><span class="navbar-toggler-bar bar1"></span><span class="navbar-toggler-bar bar2"></span><span class="navbar-toggler-bar bar3"></span></button>
</div>
<div class="collapse navbar-collapse justify-content-end" id="navigation">
<ul class="navbar-nav">
<li class="nav-item"><a class="nav-link smooth-scroll" href="#about">About</a></li>
<li class="nav-item"><a class="nav-link smooth-scroll" href="#skill">Skills</a></li>
<li class="nav-item"><a class="nav-link smooth-scroll" href="#portfolio">Portfolio</a></li>
<li class="nav-item"><a class="nav-link smooth-scroll" href="#experience">Experience</a></li>
<li class="nav-item"><a class="nav-link smooth-scroll" href="#contact">Contact</a></li>
</ul>
</div>
</div>
</nav>
</div>
</header>
<div class="page-content">
<div>
<div class="profile-page">
<div class="wrapper">
<div class="page-header page-header-small" filter-color="green">
<div class="page-header-image" data-parallax="true" style="background-image: url('images/cc-bg-1.jpg');"></div>
<div class="container">
<div class="content-center">
<div class="cc-profile-image"><a href="#"><img src="images/shubham.jpg" alt="Image"/></a></div>
<div class="h2 title">Shubham Jain</div>
<p class="category text-white">Bigdata Engineer<br />Top 5% PySpark/Apache Spark contributor on StackOverflow</p>
<a class="btn btn-primary smooth-scroll mr-2" href="#contact" data-aos="zoom-in" data-aos-anchor="data-aos-anchor">Hire Me</a><a class="btn btn-primary" href="data/Shubham_Jain_Resume_Bigdata.pdf" data-aos="zoom-in" data-aos-anchor="data-aos-anchor">Download CV</a>
</div>
</div>
<div class="section">
<div class="container">
<div class="button-container">
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://www.linkedin.com/in/shubham-jain-59326680/" rel="tooltip" title="Follow me on Linkedin"><i class="fa fa-linkedin"></i></a>
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://github.com/jnshubham" rel="tooltip" title="Follow me on Github"><i class="fa fa-github"></i></a>
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://api.whatsapp.com/send?phone=917828733244" rel="tooltip" title="Connect on Whatsapp"><i class="fa fa-whatsapp"></i></a>
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://stackoverflow.com/users/story/5352748" rel="tooltip" title="Connect on StackOverflow"><i class="fa fa-stack-overflow"></i></a>
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://www.facebook.com/shubham0307" rel="tooltip" title="Follow me on Facebook"><i class="fa fa-facebook"></i></a>
<a class="btn btn-default btn-round btn-lg btn-icon" href="https://medium.com/@jnshubham" rel="tooltip" title="Follow me on Medium"><i class="fa fa-medium"></i></a>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="section" id="about">
<div class="container">
<div class="card" data-aos="fade-up" data-aos-offset="10">
<div class="row">
<div class="col-lg-6 col-md-12">
<div class="card-body">
<div class="h4 mt-0 title">About</div>
<p>I have been a professional Bigdata Engineer since 2016. Always eager to learn new technologies.</p>
<p>I have experience in handling the complete lifecycle of a data engineering project. Be it Data Migration, Exploratory Data Analysis or creating data lake over cloud, handled the complete project with extreme dedication.</p>
</div>
</div>
<div class="col-lg-6 col-md-12">
<div class="card-body">
<div class="h4 mt-0 title">Basic Information</div>
<div class="row">
<div class="col-sm-4"><strong class="text-uppercase">Age:</strong></div>
<div class="col-sm-8">25</div>
</div>
<div class="row mt-3">
<div class="col-sm-4"><strong class="text-uppercase">Email:</strong></div>
<div class="col-sm-8">[email protected]</div>
</div>
<div class="row mt-3">
<div class="col-sm-4"><strong class="text-uppercase">Phone:</strong></div>
<div class="col-sm-8">+91-7828733244</div>
</div>
<div class="row mt-3">
<div class="col-sm-4"><strong class="text-uppercase">Address:</strong></div>
<div class="col-sm-8">Jain Mechanical Works, Pali Road, Sheopur, MP, India</div>
</div>
<div class="row mt-3">
<div class="col-sm-4"><strong class="text-uppercase">Language:</strong></div>
<div class="col-sm-8">English, Hindi</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="section" id="skill">
<div class="container">
<div class="h4 text-center mb-4 title">Professional Skills</div>
<div class="card" data-aos="fade-up" data-aos-anchor-placement="top-bottom">
<div class="card-body">
<div class="row">
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Python</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 90%;"></div>
</div>
</div>
</div>
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">SQL</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 80%;"></div>
</div>
</div>
</div>
</div>
<div class="row">
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Apache Spark</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 90%;"></div>
</div>
</div>
</div>
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Hadoop(Sqoop,Hive,Impala,Oozie,HDFS,Flume)</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 80%;"></div>
</div>
</div>
</div>
</div>
<div class="row">
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Amazon Web Services</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 80%;"></div>
</div>
</div>
</div>
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Databases (RDBMS, NoSQL)</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 80%;"></div>
</div>
</div>
</div>
</div>
<div class="row">
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Data Wrangling/EDA</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 80%;"></div>
</div>
</div>
</div>
<div class="col-md-6">
<div class="progress-container progress-primary"><span class="progress-badge">Data Modelling</span>
<div class="progress">
<div class="progress-bar progress-bar-primary" data-aos="progress-full" data-aos-offset="10" data-aos-duration="2000" role="progressbar" aria-valuenow="60" aria-valuemin="0" aria-valuemax="100" style="width: 70%;"></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="section" id="portfolio">
<div class="container">
<div class="row">
<div class="col-md-6 ml-auto mr-auto">
<div class="h4 text-center mb-4 title">Portfolio</div>
</div>
</div>
<div class="tab-content gallery mt-5">
<div class="tab-pane active" id="web-development">
<div class="ml-auto mr-auto">
<div class="row">
<div id="retainable-rss-embed" data-rss="https://medium.com/feed/@jnshubham" data-maxcols="2" data-layout="grid" data-poststyle="modal" data-readmore="Continue Reading" data-buttonclass="btn btn-primary" data-offset="0"></div>
</div>
</div>
</div>
<div class="tab-pane" id="Photography" role="tabpanel">
</div>
</div>
</div>
</div>
<div class="section" id="experience">
<div class="container cc-experience">
<div class="h4 text-center mb-4 title">Work Experience</div>
<div class="card">
<div class="row">
<div class="col-md-3 bg-primary" data-aos="fade-right" data-aos-offset="50" data-aos-duration="500">
<div class="card-body cc-experience-header">
<p>May 2019 - Present</p>
<div class="h5">Quantiphi Analytics</div>
</div>
</div>
<div class="col-md-9" data-aos="fade-left" data-aos-offset="50" data-aos-duration="500">
<div class="card-body">
<div class="h5">Big Data Engineer</div>
<p>Quantiphi is a category defining Applied AI and Machine Learning software and services company focused on helping organizations translate the big promise of Big Data & Machine Learning technologies into quantifiable business impact.</p>
<p>I have been working as a BigData Engineer fulfilling client's need for handling large and complex datasets and creating data lake on cloud. My responsibilities here includes:</p>
<ul>
<li>Design and Implementation of data lake on AWS using <strong>S3, Redshift, Glue and DMS</strong>.</li>
<li> Implementation of document style <strong>NOSQL Data Hub on AWS using DynamoDB, Glue, Step functions,
Athena, S3, EC2 and Infoworks</strong>.</li>
<li> Expertise in creating ETL pipelines with the help of <strong>Apache Spark over Glue and EMR</strong>.</li>
<li> Implementation of <strong>DynamoDB Streams to load Elasticsearch</strong> indexes for faster search results with the
help of AWS Lambda.</li>
<li> Optimizing Apache Spark jobs by optimizing joins and reducing the data shuffle over the network.</li>
<li> Optimization of Redshift cluster performance, using optimum dist keys and sort keys and tuning sql
queries for maximum performance.</li>
<li> Optimization of DynamoDB queries by implementing appropriate GSI and choosing the best partition and
sort key.</li>
<li> Implementation of Flask based API to fetch data from dynamodb and serve customer and deploying it on
AWS Elastic Container Service using Docker images.</li>
<li> Worked on creating Docker images for enabling <strong>Spark history server, glue local dev endpoints and
enabling data lineage for glue jobs and deploying them on ECS</strong>.</li>
</ul>
<p><strong>Tech Stack:</strong></p>
<p>AWS(Redshift, Glue, S3, Lambda, Redshift Spectrum), Apache Spark, Python, Pandas, Boto3, Pyarrow</p>
</div>
</div>
</div>
</div>
<div class="card">
<div class="row">
<div class="col-md-3 bg-primary" data-aos="fade-right" data-aos-offset="50" data-aos-duration="500">
<div class="card-body cc-experience-header">
<p>Dec 2016 - May2019</p>
<div class="h5">Tata Consultancy Services</div>
</div>
</div>
<div class="col-md-9" data-aos="fade-left" data-aos-offset="50" data-aos-duration="500">
<div class="card-body">
<div class="h5">System Engineer</div>
<p>My role in TCS include working with the third largest banking client, Understanding their needs with the data and devloping architecture to streamline the process in a big data ecosystem.
Majority of my responsibilities includes:
</p>
<ul>
<li>Design and implementation of python based framework to import data from various relational databases(Teradata, Oracle, SQL Server, DB2) to hadoop using Sqoop, hive and Oozie.</li>
<li>Implementing spark jdbc based data ingestion framework from Informix database.</li>
<li>Developed spark based application to parse complex xml data received as file.</li>
<li>Developed spark based reconciliation processes to maintain the data integrity in hadoop.</li>
<li>Worked Effectively with spark Dataframes and pandas Dataframes.</li>
<li>Worked in unix environment and created various unix scripts as per the requirements.</li>
<li>Imlemented Sqoop export framework for exporting the data from hadoop to Teradata.</li>
<li>Orchestration of data flow pipeline using oozie workflows from dynatrace to hdfs.</li>
<li>Handling of protobuf message format.</li>
<li>End to end setup of flume agent for fetching live transactions.</li>
<li>Used spark 2.1.0 over cloudera CDH5.13 to perform analytics on data in hive.</li>
</ul>
<p><strong>Environment</strong></p>
<p>Hadoop 2, Spark 2.1.0, Sqoop, Hive 1.4.x, Impala, Oozie, Cloudera CDH 5.13.5, Flume 1.6.0, Python 2.7, Java 1.7, Maven, Git, Jenkins</p>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="section">
<div class="container cc-education">
<div class="h4 text-center mb-4 title">Education</div>
<div class="card">
<div class="row">
<div class="col-md-3 bg-primary" data-aos="fade-right" data-aos-offset="50" data-aos-duration="500">
<div class="card-body cc-education-header">
<p>2012 - 2016</p>
<div class="h5">Bachelor's Degree</div>
</div>
</div>
<div class="col-md-9" data-aos="fade-left" data-aos-offset="50" data-aos-duration="500">
<div class="card-body">
<div class="h5">Bachelor of Engineering in Computer Science</div>
<p class="category">Maharana Pratap College of technology</p>
<p>CGPA: 8.1</p>
<p>Developed a food ordering website using Java Spring and Hibernate MVC architecture. And created a project for controlling streetlights remotely.</p>
</div>
</div>
</div>
</div>
<div class="card">
<div class="row">
<div class="col-md-3 bg-primary" data-aos="fade-right" data-aos-offset="50" data-aos-duration="500">
<div class="card-body cc-education-header">
<p>2000 - 2012</p>
<div class="h5">Higher Secondary and Secondary School</div>
</div>
</div>
<div class="col-md-9" data-aos="fade-left" data-aos-offset="50" data-aos-duration="500">
<div class="card-body">
<div class="h5">Higher Secondary (PCM)</div>
<p class="category">Nehru Higher Secondary School</p>
<p class="category">Perceentage: 84.4%</p>
<div class="h5">Secondary School</div>
<p class="category">Nehru Higher Secondary School</p>
<p class="category">Perceentage: 82.3%</p>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="section" id="contact">
<div class="cc-contact-information" style="background-image: url('images/staticmap.png');">
<div class="container">
<div class="cc-contact">
<div class="row">
<div class="col-md-9">
<div class="card mb-0" data-aos="zoom-in">
<div class="h4 text-center title">Contact Me</div>
<div class="row">
<div class="col-md-6">
<div class="card-body">
<p class="mb-0"><strong>Address </strong></p>
<p class="pb-2">A/9, Divine Lights CHS, Hanuman Nagar, Andheri East, Mumbai, Maharashtra(400093)</p>
<p class="mb-0"><strong>Phone</strong></p>
<p class="pb-2">+91-7828733244</p>
<p class="mb-0"><strong>Email</strong></p>
<p>[email protected]</p>
</div>
</div>
<div class="container text-center">
<a class="cc-linkedin btn btn-link " href="https://www.linkedin.com/in/shubham-jain-59326680/"><i class="fa fa-linkedin fa-2x " aria-hidden="true"></i></a>
<a class="cc-github btn btn-link " href="https://github.com/jnshubham"><i class="fa fa-github fa-2x " aria-hidden="true"></i></a>
<a class="cc-whatsapp btn btn-link " href="https://api.whatsapp.com/send?phone=917828733244"><i class="fa fa-whatsapp fa-2x " aria-hidden="true"></i></a>
<a class="cc-facebook btn btn-link" href="https://www.facebook.com/shubham0307"><i class="fa fa-facebook fa-2x " aria-hidden="true"></i></a>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div></div>
</div>
<footer class="footer">
<div class="container text-center">
<a class="cc-linkedin btn btn-link " href="https://www.linkedin.com/in/shubham-jain-59326680/"><i class="fa fa-linkedin fa-2x " aria-hidden="true"></i></a>
<a class="cc-github btn btn-link " href="https://github.com/jnshubham"><i class="fa fa-github fa-2x " aria-hidden="true"></i></a>
<a class="cc-whatsapp btn btn-link " href="https://api.whatsapp.com/send?phone=917828733244"><i class="fa fa-whatsapp fa-2x " aria-hidden="true"></i></a>
<a class="cc-facebook btn btn-link" href="https://www.facebook.com/shubham0307"><i class="fa fa-facebook fa-2x " aria-hidden="true"></i></a>
</div>
<div class="h4 title text-center">Shubham Jain</div>
<div class="text-center text-muted">
<p>© Creative CV. All rights reserved.<br>Design - <a class="credit" href="https://templateflip.com" target="_blank">TemplateFlip</a></p>
</div>
</footer>
<script src="js/core/jquery.3.2.1.min.js"></script>
<script src="js/core/popper.min.js"></script>
<script src="js/core/bootstrap.min.js"></script>
<script src="js/now-ui-kit.js?v=1.1.0"></script>
<script src="js/aos.js"></script>
<script src="scripts/main.js"></script>
<script src="https://www.retainable.io/assets/retainable/rss-embed/retainable-rss-embed.js"></script>
</body>
</html>