Skip to content

Hive

HiveReader #

Bases: BaseReader

Read documents from a Hive.

These documents can then be used in a downstream Llama Index data structure.

Parameters:

Name Type Description Default
host

What host HiveServer2 runs on

 required
port

The port Hive Server runs on. Defaults to 10000.

 None
auth

The value of hive.server2.authentication used by HiveServer2. Defaults to NONE

 None
database Optional[str]

the database name

 None
password Optional[str]

Use with auth='LDAP' or auth='CUSTOM' only

 None
Source code in llama-index-integrations/readers/llama-index-readers-hive/llama_index/readers/hive/base.py 
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
class HiveReader(BaseReader):
    """
    Read documents from a Hive.

    These documents can then be used in a downstream Llama Index data structure.

    Args:
        host : What host HiveServer2 runs on
        port : The port Hive Server runs on. Defaults to 10000.
        auth : The value of hive.server2.authentication used by HiveServer2.
               Defaults to ``NONE``
        database: the database name
        password: Use with auth='LDAP' or auth='CUSTOM' only

    """

    def __init__(
        self,
        host: str,
        port: Optional[int] = None,
        database: Optional[str] = None,
        username: Optional[str] = None,
        password: Optional[str] = None,
        auth: Optional[str] = None,
    ):
        """Initialize with parameters."""
        try:
            from pyhive import hive
        except ImportError:
            raise ImportError(
                "`hive` package not found, please run `pip install pyhive`"
            )

        self.con = hive.Connection(
            host=host,
            port=port,
            username=username,
            database=database,
            auth=auth,
            password=password,
        )

    def load_data(self, query: str) -> List[Document]:
        """Read data from the Hive.

        Args:
            query (str): The query used to query data from Hive
        Returns:
            List[Document]: A list of documents.

        """
        try:
            cursor = self.con.cursor().execute(query)
            cursor.execute(query)
            rows = cursor.fetchall()
        except Exception:
            raise Exception(
                "Throws Exception in execution, please check your connection params and query "
            )

        documents = []
        for row in rows:
            documents = Document(text=row)
        return documents

load_data #

load_data(query: str) -> List[Document]

Read data from the Hive.

Parameters:

Name Type Description Default
query str

The query used to query data from Hive

 required

Returns: List[Document]: A list of documents.

Source code in llama-index-integrations/readers/llama-index-readers-hive/llama_index/readers/hive/base.py 
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
def load_data(self, query: str) -> List[Document]:
    """Read data from the Hive.

    Args:
        query (str): The query used to query data from Hive
    Returns:
        List[Document]: A list of documents.

    """
    try:
        cursor = self.con.cursor().execute(query)
        cursor.execute(query)
        rows = cursor.fetchall()
    except Exception:
        raise Exception(
            "Throws Exception in execution, please check your connection params and query "
        )

    documents = []
    for row in rows:
        documents = Document(text=row)
    return documents