Skip to content

Missing Values in Table Statement

11 messages · John Kane, MacQueen, Don, Shivi82 +1 more

Original
Shivi82
# 
HI All,

I need help on 2 issues as highlighted below"

A)I have 2 variables:- Sch_Time & Origin Name.
Now there are multiple instances where Scheduled time i.e. Sch_Time is
missing from each location hence i need to count how many instances do i
have split on location. 
the code i have is :
table(test$ORIGIN_NAME,is.na(test$SCH_TIME)) 
but with code it is not giving any value as TRUE & in FALSE all the values
are total count of scheduled departure.

Could you please suggest what should be the solution for the same. Would it
be because of var i am dealing with as result of typeof(test$ORIGIN_NAME) &
typeof(test$SCH_TIME) both result to character. 

B) In the cross table can we show the proportion of values under each head
as in %. 
table(test$CR_DT)/10765*100. Here i am trying to find how many values
appearing on a date basis where 10765 is my total data count.

Kindly let me know if i need to supply dput data. Thank you!!!




--
View this message in context: http://r.789695.n4.nabble.com/Missing-Values-in-Table-Statement-tp4708534.html
Sent from the R help mailing list archive at Nabble.com.
PIKAL Petr
# 
Hi
Table gives you count for each category of a factor. You say that you want count instances but then you complain you get them. I am puzzled.
see also ?prop.table
It is way easier to understand your problem with reproducible example for which data is important part.

Cheers
Petr
________________________________
Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou ur?eny pouze jeho adres?t?m.
Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen? jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze sv?ho syst?mu.
Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi ?i zpo?d?n?m p?enosu e-mailu.

V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
- vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en? smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
- a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout; Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce s dodatkem ?i odchylkou.
- trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m dosa?en?m shody na v?ech jej?ch n?le?itostech.
- odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je adres?tovi ?i osob? j?m zastoupen? zn?m?.

This e-mail and any documents attached to it may be confidential and are intended only for its intended recipients.
If you received this e-mail by mistake, please immediately inform its sender. Delete the contents of this e-mail with all attachments and its copies from your system.
If you are not the intended recipient of this e-mail, you are not authorized to use, disseminate, copy or disclose this e-mail in any manner.
The sender of this e-mail shall not be liable for any possible damage caused by modifications of the e-mail or by delay with transfer of the email.

In case that this e-mail forms part of business dealings:
- the sender reserves the right to end negotiations about entering into a contract in any time, for any reason, and without stating any reasoning.
- if the e-mail contains an offer, the recipient is entitled to immediately accept such offer; The sender of this e-mail (offer) excludes any acceptance of the offer on the part of the recipient containing any amendment or variation.
- the sender insists on that the respective contract is concluded only upon an express mutual agreement on all its aspects.
- the sender of this e-mail informs that he/she is not authorized to enter into any contracts on behalf of the company except for cases in which he/she is expressly authorized to do so in writing, and such authorization or power of attorney is submitted to the recipient or the person represented by the recipient, or the existence of such authorization is known to the recipient of the person represented by the recipient.
Shivi82
# 
Hi Petr,

Probably i did not explain my scenario clearly.
 table(test$ORIGIN_NAME,is.na(test$SCH_TIME)) is the syntax with which i am
trying to find per destination wise how many instances are there where
system failed to enter the scheduled delivery time & there are multiple
cases of these. I am expecting an output where TRUE and FALSE will give
number of observations either missing or non-missing. 

ORIGIN         ORIGIN_NAME DESTINATION      DESTINATION_NM  RPS_NO
DLI11            DELHI-11       NDA50                  NOIDA-50            
1350760
NDA50            NOIDA-50     DLI11                    DELHI-11            
1352692 


SCH_TIME  ACTUAL_DEP_DATE ACTUAL_DEP_TIME WAYBILLS TOTAL_PKG ACTUAL_WT
CHG_WT
6:00         13/03/2015                    6:30                      -          
0                  0                0
21:30       15/03/2015                   13:37                     28       
256           3419               3730


Hopefully i am able to make my self now clear. Thank you. 







--
View this message in context: http://r.789695.n4.nabble.com/Missing-Values-in-Table-Statement-tp4708534p4708537.html
Sent from the R help mailing list archive at Nabble.com.
Shivi82
# 
Hi Petr, Please see the output from dget as follows.

ORIGIN         ORIGIN_NAME DESTINATION      DESTINATION_NM  RPS_NO                                 
VENDOR_NAME     CR_DT SCHD_MRKT     VHL_NO vhl_cap
1      DLI11            DELHI-11       NDA50            NOIDA-50 1350760                                
RAJIV GAUTAM 13-Mar-15  SCHEDULE  HR63A0931       8
2      DLI11            DELHI-11       NDA50            NOIDA-50 1366368                                
RAJIV GAUTAM 31-Mar-15  SCHEDULE  HR63A0931       8
3      NDA50            NOIDA-50       DLI11            DELHI-11 1352692                                
RAJIV GAUTAM 15-Mar-15  SCHEDULE  HR63A0931       8
4      NDA50            NOIDA-50       NDA11            NOIDA-11 1354642                                
RAJIV GAUTAM 17-Mar-15    MARKET  HR63A0931       8
5      NDA50            NOIDA-50       DLI11            DELHI-11 1354642                                
RAJIV GAUTAM 17-Mar-15    MARKET  HR63A0931       8
      SCH_TIME ACTUAL_DEP_DATE ACTUAL_DEP_TIME WAYBILLS TOTAL_PKG ACTUAL_WT
CHG_WT                                                  RTE_CD
1         6:00      13/03/2015            6:30        -         0         0     
0                          DELHI-11-NOIDA-50(DLI11-NDA50)
2         6:00      31/03/2015            4:05        -         0         0     
0                          DELHI-11-NOIDA-50(DLI11-NDA50)
3        21:30      15/03/2015           13:37        -         0         0     
0                          NOIDA-50-DELHI-11(NDA50-DLI11)
4                   17/03/2015           20:15        3        40       744   
770                    NOIDA-50-DELHI-11(NDA50-NDA11-DLI11)
5                   17/03/2015           20:15       28       256      3419  
3730                    NOIDA-50-DELHI-11(NDA50-NDA11-DLI11)



--
View this message in context: http://r.789695.n4.nabble.com/Missing-Values-in-Table-Statement-tp4708534p4708540.html
Sent from the R help mailing list archive at Nabble.com.
PIKAL Petr
# 
Hi
This is what **I** get.
Error in table(test$ORIGIN_NAME, is.na(test$SCH_TIME)) :
  object 'test' not found
As I said output of table is not logical but numeric.
Not really.

Cheers
Petr
________________________________
Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou ur?eny pouze jeho adres?t?m.
Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen? jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze sv?ho syst?mu.
Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi ?i zpo?d?n?m p?enosu e-mailu.

V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
- vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en? smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
- a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout; Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce s dodatkem ?i odchylkou.
- trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m dosa?en?m shody na v?ech jej?ch n?le?itostech.
- odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je adres?tovi ?i osob? j?m zastoupen? zn?m?.

This e-mail and any documents attached to it may be confidential and are intended only for its intended recipients.
If you received this e-mail by mistake, please immediately inform its sender. Delete the contents of this e-mail with all attachments and its copies from your system.
If you are not the intended recipient of this e-mail, you are not authorized to use, disseminate, copy or disclose this e-mail in any manner.
The sender of this e-mail shall not be liable for any possible damage caused by modifications of the e-mail or by delay with transfer of the email.

In case that this e-mail forms part of business dealings:
- the sender reserves the right to end negotiations about entering into a contract in any time, for any reason, and without stating any reasoning.
- if the e-mail contains an offer, the recipient is entitled to immediately accept such offer; The sender of this e-mail (offer) excludes any acceptance of the offer on the part of the recipient containing any amendment or variation.
- the sender insists on that the respective contract is concluded only upon an express mutual agreement on all its aspects.
- the sender of this e-mail informs that he/she is not authorized to enter into any contracts on behalf of the company except for cases in which he/she is expressly authorized to do so in writing, and such authorization or power of attorney is submitted to the recipient or the person represented by the recipient, or the existence of such authorization is known to the recipient of the person represented by the recipient.
John Kane
# 
If possible always supply  data in dput() form. 
John Kane
Kingston ON Canada
____________________________________________________________
FREE 3D EARTH SCREENSAVER - Watch the Earth right on your desktop!
MacQueen, Don
# 
Maybe it will help if I create some fake data to illustrate what I think
you want:

set.seed(25)
tmp <- data.frame(origin=sample( letters[1:3], 25, replace=TRUE),
                  schd= sample( 1:5, 25, replace=TRUE)
                  )
tmp$schd[ c(5,7,18,22) ] <- NA

print(tmp)


table( tmp$origin, is.na(tmp$schd))
   
    FALSE TRUE
  a     9    1
  b     6    2
  c     6    1




## a little fancier

table( tmp$origin, ifelse(is.na(tmp$schd),'missing','available'))
   
    available missing
  a         9       1
  b         6       2
  c         6       1



For example, for schedule "b" there are 6 instances for which the sched
time has been entered and 2 where it has not.


In this example, the table() function is working correctly.

I don't think anyone understands what is wrong with the output you are
getting.
Shivi82
# 
HI Don,

This is the exact result i need. However in my case i am not getting any
value under TRUE whereas FALSE captures total observations in each variable.
Please find the syntax and output from the code:
table(test$ORIGIN_NAME,is.na(test$SCH_TIME))

Output
                                 FALSE
  BAHADURGARH            15
  BAREILLY                    44
  BAWAL                        34
  DELHI-11                   2446
  DELHI-39                   170
  DELHI-40                   86
  DELHI NCR-12            1925

The data from str is attached:
data.frame':	10765 obs. of  18 variables:
 $ ORIGIN         : chr  "DLI11" "DLI11" "NDA50" "NDA50" ...
 $ ORIGIN_NAME    : chr  "DELHI-11" "DELHI-11" "NOIDA-50" "NOIDA-50" ...
 $ DESTINATION    : chr  "NDA50" "NDA50" "DLI11" "NDA11" ...
 $ DESTINATION_NM : chr  "NOIDA-50" "NOIDA-50" "DELHI-11" "NOIDA-11" ...
 $ RPS_NO         : int  1350760 1366368 1352692 1354642 1354642 1349180
1349180 1356091 1348591 1348591 ...
 $ VENDOR_NAME    : chr  "RAJIV GAUTAM" "RAJIV GAUTAM" "RAJIV GAUTAM" "RAJIV
GAUTAM" ...
 $ CR_DT          : chr  "13-Mar-15" "31-Mar-15" "15-Mar-15" "17-Mar-15" ...
 $ SCHD_MRKT      : chr  "SCHEDULE" "SCHEDULE" "SCHEDULE" "MARKET" ...
 $ VHL_NO         : chr  "HR63A0931" "HR63A0931" "HR63A0931" "HR63A0931" ...
 $ vhl_cap        : int  8 8 8 8 8 8 8 8 8 8 ...
 $ SCH_TIME       : chr  "6:00" "6:00" "21:30" "" ...
 $ ACTUAL_DEP_DATE: chr  "13/03/2015" "31/03/2015" "15/03/2015" "17/03/2015"
...
 $ ACTUAL_DEP_TIME: chr  "6:30" "4:05" "13:37" "20:15" ...
 $ WAYBILLS       : chr  "-" "-" "-" "3" ...
 $ TOTAL_PKG      : int  0 0 0 40 256 6 0 0 16 427 ...
 $ ACTUAL_WT      : int  0 0 0 744 3419 65 0 0 193 7223 ...
 $ CHG_WT         : int  0 0 0 770 3730 70 0 0 210 7310 ...
 $ RTE_CD         : chr  "DELHI-11-NOIDA-50(DLI11-NDA50)"
"DELHI-11-NOIDA-50(DLI11-NDA50)" "NOIDA-50-DELHI-11(NDA50-DLI11)"
"NOIDA-50-DELHI-11(NDA50-NDA11-DLI11)"
Scheduled time here is character, could this be the reason for the incorrect
result. 

Thanks, Shivi




--
View this message in context: http://r.789695.n4.nabble.com/Missing-Values-in-Table-Statement-tp4708534p4708593.html
Sent from the R help mailing list archive at Nabble.com.
2 days later
PIKAL Petr
# 
Hi

Why you are so reluctant to use dput for sending us part of your data?

The result of str indicates that that SCH_TIME is character vector in which some values are time and others are **empty** strings. But empty string does not mean it is missing string.

***Empty bottle of whisky is not missing bottle of whisky***.

So is.na correctly finds that none of your values are missing.

see this example

test<-sample(letters[1:5], 10, replace=T)
test[5:7]<-NA
str(test)
 chr [1:10] "b" "a" "d" "e" NA NA NA "d" "d" "c"

table(is.na(test))

FALSE  TRUE
    7     3

test[5:7]<-""
str(test)
 chr [1:10] "b" "a" "d" "e" "" "" "" "d" "d" "c"
table(is.na(test))

FALSE
   10

Cheers
Petr
________________________________
Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou ur?eny pouze jeho adres?t?m.
Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen? jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze sv?ho syst?mu.
Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi ?i zpo?d?n?m p?enosu e-mailu.

V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
- vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en? smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
- a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout; Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce s dodatkem ?i odchylkou.
- trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m dosa?en?m shody na v?ech jej?ch n?le?itostech.
- odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je adres?tovi ?i osob? j?m zastoupen? zn?m?.

This e-mail and any documents attached to it may be confidential and are intended only for its intended recipients.
If you received this e-mail by mistake, please immediately inform its sender. Delete the contents of this e-mail with all attachments and its copies from your system.
If you are not the intended recipient of this e-mail, you are not authorized to use, disseminate, copy or disclose this e-mail in any manner.
The sender of this e-mail shall not be liable for any possible damage caused by modifications of the e-mail or by delay with transfer of the email.

In case that this e-mail forms part of business dealings:
- the sender reserves the right to end negotiations about entering into a contract in any time, for any reason, and without stating any reasoning.
- if the e-mail contains an offer, the recipient is entitled to immediately accept such offer; The sender of this e-mail (offer) excludes any acceptance of the offer on the part of the recipient containing any amendment or variation.
- the sender insists on that the respective contract is concluded only upon an express mutual agreement on all its aspects.
- the sender of this e-mail informs that he/she is not authorized to enter into any contracts on behalf of the company except for cases in which he/she is expressly authorized to do so in writing, and such authorization or power of attorney is submitted to the recipient or the person represented by the recipient, or the existence of such authorization is known to the recipient of the person represented by the recipient.
Shivi82
# 
HI Petr,There is no reason for holding back the data from dput format. The
reason for not supplying is that i tried multiple times but it the output
what comes is not really user friendly is what i think.Not sure if i am
missing a trick somewhere as i tried both the dput and dget options. Though
as you highlighted below i will once again check the time column to see what
values are empty.Thanks, Shivi



--
View this message in context: http://r.789695.n4.nabble.com/Missing-Values-in-Table-Statement-tp4708534p4708674.html
Sent from the R help mailing list archive at Nabble.com.
PIKAL Petr
# 
Hi

actually output from dput is the most user friendly way of supplying data.

try just copy this part below

-----

temp <- structure(list(dusik = c(1814L, 2844L, 3121L, 3286L, 3515L, 2478L,
1891L), kyslik = c(5224L, 8632L, 9214L, 9765L, 10428L, 7403L,
5469L), co2 = c(20188L, 32118L, 35299L, 36781L, 39340L, 28136L,
20980L), pevnost = c(6.3, 5.82, 6.89, 5.49, 8.4, 8.6, 10.6),
    dlou = c(81.2, 102.6, 146.2, 87.2, 154.6, 177.1, 170.2),
    adit = structure(c(4L, 2L, 2L, 3L, 3L, 1L, 1L), .Label = c("adi",
    "cg100", "cg100mod", "nic"), class = "factor"), pridavek = c(0L,
    3L, 5L, 3L, 5L, 3L, 5L)), .Names = c("dusik", "kyslik", "co2",
"pevnost", "dlou", "adit", "pridavek"), class = "data.frame", row.names = c(NA,
-7L))

----

and put it to your R console. It will create object named temp as you can easily check.

Cheers
Petr
________________________________
Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou ur?eny pouze jeho adres?t?m.
Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen? jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze sv?ho syst?mu.
Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi ?i zpo?d?n?m p?enosu e-mailu.

V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
- vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en? smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
- a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout; Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce s dodatkem ?i odchylkou.
- trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m dosa?en?m shody na v?ech jej?ch n?le?itostech.
- odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je adres?tovi ?i osob? j?m zastoupen? zn?m?.

This e-mail and any documents attached to it may be confidential and are intended only for its intended recipients.
If you received this e-mail by mistake, please immediately inform its sender. Delete the contents of this e-mail with all attachments and its copies from your system.
If you are not the intended recipient of this e-mail, you are not authorized to use, disseminate, copy or disclose this e-mail in any manner.
The sender of this e-mail shall not be liable for any possible damage caused by modifications of the e-mail or by delay with transfer of the email.

In case that this e-mail forms part of business dealings:
- the sender reserves the right to end negotiations about entering into a contract in any time, for any reason, and without stating any reasoning.
- if the e-mail contains an offer, the recipient is entitled to immediately accept such offer; The sender of this e-mail (offer) excludes any acceptance of the offer on the part of the recipient containing any amendment or variation.
- the sender insists on that the respective contract is concluded only upon an express mutual agreement on all its aspects.
- the sender of this e-mail informs that he/she is not authorized to enter into any contracts on behalf of the company except for cases in which he/she is expressly authorized to do so in writing, and such authorization or power of attorney is submitted to the recipient or the person represented by the recipient, or the existence of such authorization is known to the recipient of the person represented by the recipient.