Learning BI

This python script lists out users , email and status from Informatica. You need to replace your username, password and informatica url. import requests import json import sys import datetime import smtplib, ssl from email.mime.base import MIMEBase from email.mime.text import MIMEText from email.mime.multipart import MIMEMultipart filename="userslist.txt" username = "" password = "" current_timestamp = datetime.datetime.utcnow().strftime('%Y-%m-%d %H:%M:%S') with open(filename, 'w') as f:   f.write(current_timestamp+'\n') username = username password = password url = "https://dm-us.informaticacloud.com/saas/public/core/v3/login" payload = json.dumps({   "username": username,   "password": password }) headers = {   'Content-Type': 'application/json',   'Accept': 'application/json' } response = requests.request("POST", url, headers=headers, data=payload) login=jso...

 I have written a  python script to pull list of groups and associated users in ICCS using API.  In script you need to replace url and Id and password that has admin access in your environment.  Here is the script import requests import json sid= '' url = "https:Infaurl/api/v2/user/login" payload = json.dumps({ "username" : "Adminuser" , "password" : "Adminpassword" }) headers = { 'Content-Type' : 'application/json' , 'Accept' : 'application/json' } response = requests.request( "POST" , url, headers =headers, data =payload) print (response.text) login=json.loads(response.text) for i in login: if i== "icSessionId" : sid=login[i] #print(sid) groupurl = "https://infaurl/public/core/v3/userGroups?limit=50" payload = {} grpheaders = { 'INFA-SESSION-ID' : sid } groupresponse = requests.request( "GET" , groupurl, headers =grphe...

 Terraform Written Notes.  I have used this notes to clear my Terraform Associate Certification 

 Script to get Disabled users in IICS   This script user Informatica Cloud APIs to get user details and pulls disabled and locked users even if SAML is integrated. You need to replace username, password, send email, receiver email and SMPT server so that it generated disabled users list for that org in the same path from where you are running the script.  import requests import json import sys import datetime import smtplib, ssl from email.mime.base import MIMEBase from email.mime.text import MIMEText from email.mime.multipart import MIMEMultipart filename= "userslist.txt" username = "username" password = "Password" current_timestamp = datetime.datetime.utcnow().strftime( '%Y-%m-%d %H:%M:%S' ) with open (filename, 'w' ) as f: f.write(current_timestamp+ ' \n ' ) username = username password = password url = "https://dm-us.informaticacloud.com/saas/public/core/v3/login" payload = json.dumps({ "username" : user...

  1. How will you describe Airflow? Apache Airflow is referred to an open-source platform that is used for workflow management. This one is a data transformation pipeline Extract, Transform, Load (ETL) workflow orchestration tool. It initiated its operations back in October 2014 at Airbnb. At that time, it offered a solution to manage the increasingly complicated workflows of a company. This Airflow tool allowed them to programmatically write, schedule and regulate the workflows through an inbuilt  Airflow user interface.  2. What are the problems resolved by Airflow? Some of the issues and problems resolved by Airflow include: Maintaining an audit trail of every completed task Scalable in nature Creating and maintaining a relationship between tasks with ease Comes with a UI that can track and monitor the execution of the workflow and more. 3. What are some of the features of Apache Airflow? Some of the features of Apache Airflow include: It helps schedule all the jobs an...

 As we  Tableau is considered as one of the best BI and Data Visualization tools and has bundle of unique features that makes it more popular, lets learn few of them .  I will  be explaining them in detail in further posts. Please add any features in the comments that I have missed adding here.  Tableau features :  API Access Control Active Directory Integration Activity Dashboard Ad hoc Analysis Ad hoc Query Ad hoc Reporting Categorization Collaboration Tools Content Library Custom Fields Customizable Reporting Dashboard Creation Data filtering, import/export, mapping, storage management, visualization. Database Integration Drag & Drop Interface Email Integration Email Notifications Filtered Views Gantt Charts Geographic Maps Geolocation Interactive Content Metadata Management Multiple Projects Offline Access Permission Management, Role-Based Permissions Real-Time Analytics, Real-Time Data Self Service Portal Task Management Third-Party Integration Tre...

  You need to have a Snowflake Data platform for it . If not please create one as below: You can start by signing up for a free trial on Snowflake: Sign up for a free trial by following link https://signup.snowflake.com/ and completing the sign-up form. Select the Enterprise edition, choose a cloud provider and region, and agree to the terms of service. Click GET STARTED. After submitting the sign-up form, you should receive an email asking you to activate your account. Click the link in the email and a new tab will open up where you’ll create your username and password. Complete the form and click Get started. Congrats! Your workspace is ready for some data.  Now to load sample data use below queries. #creating Warehouse, Database and schemas create warehouse transforming; create database raw; create database analytics; create schema raw.jaffle_shop; create schema raw.stripe; #creating customer table and loading Data create table raw.jaffle_shop.customers  ( id integer, ...