Big Data

Hi everyone! Today I want to share with you my experience as an intern/trainee joining the big data/data analytics team. It was a very exciting and fun day, having learned lots of new things.

The schedule and AWS

After coming into the office, I got a brief introduction to Amazons Web Services (AWS) which is the cloud computing platform used by 1NCE. And after having figured out how to make me get all the necessary rights to use features such as Lambda, Redshift, and Quicksight, I got a task for the day: I combined 6 Excel files with customer data and imported the new file (the file was huge by the way) into S3, which is a simple object/data storage service on AWS. Next, I took the data from S3 and loaded it into Redshift, a powerful (and pretty complicated ????) data warehouse thingy controlled by SQL. Having already worked with SQL statements was pretty useful here. We sorted and queried the data with SQL statements! I really enjoyed writing SQL queries and exploring the results in Redshift!

Finally, I had to use Quicksight, which is a data visualization software similar to Tableau (couldn’t figure out how to manage the Tableau user rights, so we used Quicksight) letting us create interactive dashboards and charts. I was pretty surprised by how intuitive Quicksight is and could explore different settings and filters.

Also, I figured the 1NCE OS team isn’t the only one always going for a walk after lunch – Big Data does that too! Love that!

18:30

As all of these topics really struck me I ended up leaving the office really late, but definitely enjoyed my time till the very end.

I had a great time with the Big Data team and Uldis – huge thanks! Looking forward to getting to know the company’s IT team tomorrow! Thanks for reading!