INSTALLATION DOCUMENTS BY RAVI

Showing posts with label HADOOP. Show all posts
Showing posts with label HADOOP. Show all posts

Saturday, August 25, 2018

Uploading templates in Apache Nifi HDF

Open Nifi UI

http://localhost:9090/nifi/



















In the operating window click on upload template



















Browse the template xml file and click on upload



















We will get template successfully imported message.



















In order to check for the uploaded template, drag the template button on to the canvas



















Select the uploaded template name and click on Add



















Now we will get the data flow of the uploaded template




















Error: Cannot delete Process Group because it contains 1 Templates Apache Nifi HDF

Node sandbox-hdf.hortonworks.com:9090 is unable to fulfill this request due to: Cannot delete Process Group because it contains 1 Templates. The Templates must be deleted first.

















Templates, when created, are not inherently made available to all users.
They are tightly coupled to the authorization policies of the process group they are created in.
Since these templates are coupled in this way to a particular process group, that process group cannot be deleted until those associated templates are removed.

Removing the template:
Go to templates as shown in the below screen.

















Before removing the template, backup the template by downloading it

















































Now click on remove template to remove

















Click on yes to delete the template





























Like this remove all the templates with same “Process Group Id”

Close the Nifi templates page and try to delete the processor group now



































Thursday, July 26, 2018

Apache superset installation and configuration

Installing prerequisites:


Python:





Cryptography:












Virtualenv:


















Setting virtualenv environment:







Activating virtualenv:




Upgrading setup tools:







Installing superset:

















Creating admin user for superset:












Getting error “no module named pandas.core”

Upgrading pandas to resolve the issue:

































Again try to create the admin user:








Upgrading the superset database:










Getting error “ImportError: cannot import name ‘ExtDeprecationWarning”

To resolve this install the prerequisites in the Requirements.txt file as below:

Note: If the file is not there create the file and add the below requisites in it.

Requirements.txt
bleach==2.1.2
boto3==1.4.7
botocore==1.7.48
celery==4.2.0
colorama==0.3.9
cryptography==1.9
flask==0.12.2
flask-appbuilder==1.10.0
flask-caching==1.4.0
flask-compress==1.4.0
flask-migrate==2.1.1
flask-testing==0.7.1
flask-wtf==0.14.2
flower==0.9.2
future==0.16.0
geopy==1.11.0
gunicorn==19.8.0
humanize==0.5.1
idna==2.6
isodate==0.6.0
markdown==2.6.11
pandas==0.23.1
parsedatetime==2.0.0
pathlib2==2.3.0
polyline==1.3.2
pydruid==0.4.4
pyhive==0.5.1
python-dateutil==2.6.1
python-geohash==0.8.5
pyyaml==3.12
requests==2.18.4
simplejson==3.15.0
six==1.11.0
sqlalchemy==1.2.2
sqlalchemy-utils==0.32.21
sqlparse==0.2.4
tableschema==1.1.0
thrift==0.11.0
thrift-sasl==0.3.0
unicodecsv==0.14.1
unidecode==1.0.22
contextlib2==0.5.5

















After the requirements installed successfully upgrade superset database again































Loading the default examples:


















Initializing the superset:














Starting the superset server:














Accessing superset console:














































Wednesday, July 4, 2018

ERROR: Failed to create collection 'myhdfscore1' due to: create the collection time out:180s

When trying to create a collection in solr getting the below error

"ERROR: Failed to create collection 'myhdfscore1' due to: create the collection time out:180s"










To resolve this

Login to ambari console and stop Ambari infra



















Stop Zookeeper



















Start Zookeeper 


Start Ambari Infra



















Now try to create the collection again



































Integrating solr with banana in hortonworks

Download and extract banana






























Copy banana folder to $SOLR_HOME/server/solr-webapp/webapp/








Creating a collection for banana:




































banana url:






















  Opatch reports 'Cyclic Dependency Detected' error when patching ODI   Issue: When applying a Patch Set Update (PSU) to WebLogic Se...